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ABSTRACT 

Existing  algorithms  for  computing  the  optimal  distribution 
of  effort  in  search  for  a moving  target  operate  by  producing 
a sequence  of  progressively  better  distributions.  This  report 
shows  how  to  compute  an  upper  bound  on  the  detection  prob- 
ability for  each  of  those  effort  distributions  in  the  case  where 
the  detection  function  is  concave. 
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1.  INTRODUCTION 

The  object  is  to  detect  a randomly  moving  target  at  one 
of  the  discrete  times  0,1,..., t.  The  searcher  determines  a non- 
negative effort  distribution  ty(x,t)  such  that  the  total  effort 
applied  at  time  t does  not  exceed  m(t) . Our  purpose  here  is  to 
establish  an  upper  bound  on  the  detection  probability  for  every 
effort  distribution.  This  is  intended  to  supplement  existing 
iterative  procedures  that  develop  sequences  of  effort  distributions 
that  improve  monotonically . 


2.  THE  GENERAL  CASE 

Let  w(x,t)  be  an  "effectiveness  coefficient"  for  search 
effort  applied  at  position  x at  time  t.  If  Xfc  is  the  position 
of  the  target  at  time  t,  then  the  probability  of  detection  depends, 
we  assume,  only  on  the  total  effective  search  effort 

T 

z = l W<x.,t)  tMx.,t)  . 

t-0  1 r 

Specifically  the  probability  of  detection  is  P(^)  - E(b(Z)), 
where  the  expectation  operator  is  needed  because  X^.  is  a 
stochastic  process.  We  assume  that  b(z')  -b(z)  £s(z)  (z1  - z) 
for  some  function  s(z)  and  for  all  z';  if  the  detection 
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function  b is  concave  and  differentiable,  then  s(z)  is 
just  b(z).  In  most  applications,  b(z)  ■ 1 - exp(-z) 
and  s (z)  **  exp  (-z)  . 

Let  iff  and  4)*  be  two  effort  distributions.  Then 

(1)  P (t|>»  ) - P (^)  - E(b(Z’)  - b(z))  < E(s(z)  (Z'-Z>) 

We  also  have 

T 

(2)  E(s(Z)  (Z'-Z))  « l E (s  ( 2)  W (X,  , t)  [ij>'(X.,t)  -i|»(X,t)]) 

t-0  c t r 

We  now  consider  two  cases,  depending  on  whether  Xfc  is 
discrete  or  continuous.  If  Xfc  is  discrete,  we  let  pt(x) 
be  the  probability  mass  function  of  Xfc,  and  require 

l 4>'  (x,t)  **  l if>('X,t)  - m(t)  . 
x x 


We  define 

(3)  DT(4>,x,t)  = w(x,t)  Pt(x)  E(s(Z)|xt«x) 

Then  (2)  can  be  written 

T 

(4)  E(s(z)  (Z  1 — Z ) ) D (iff , x,  t)  [ijf' (x,t)  - ip  (x , t)  ] 

t=0  x T 
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If  xt  is  continuous,  1st  pt(x)  be  the  probability  density 
functi  ' of  X , and  require  / if)'(x,t)dx  ■ / ii»(x,t)dx  » m(t)  . 

b 

Then  (2)  can  be  written 


T 

(4')  E(S<2)  (Z'-Z)J  - l I D _(^,X,t)  [ip'(x,t)  - i|i(x,t)]dx  . 

t»0 


In  either  case,  suppose  that  DT(^,x,t)  <_  X(t)  for  all  x,  and 
D (ihx, t)  >_  Mt)  when  tj/{x,t)  > 0*  In  th®  discrete  case, 
from  ( 4 ) , 


(5)  E(s(Z)  (Z'-Z)  ) < l [J  X{t)ll>'  (x,t)  - l A \|»(x,t)  ] 

t*»0  x x 


- I (X(t)  - X(t))  m(t) 
t=0 


Combining  (5)  and  (1) , 

T 

(6)  P(V)  - P(t)  < I (A(t)  - X (t) } m(t)  i AW 

t-0 

A formula  similar  to  (5)  shows  that  (6)  must  also  hold  in  the 
continuous  case. 

Now  ip'  is  not  needed  to  compute  any  of  the  quantities 
on  the  right-hand  side  of  (6)  , so  every  effort  density  <|>'  has 
associated  with  it  an  upper  bound  on  the  detection  probability 
P{ty)  + A(ty)  . In  the  event  X (t)  * \{t)  for  all  t,  \p  must 
actually  be  optimal — this  has  been  observed  by  Stone  [1] , and 
in  fact  our  whole  development  is  a modification  of  his 
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sufficiency  proof.  The  main  issue  is  now  computational:  is 
determination  of  A(ij>)  worth  the  effort? 


3.  THE  CASE  OF  MARKOV  MOTION  AND  EXPONENTIAL  DETECTION  FUNCTION. 
Let 

Z - z”  + w(xt,t)  iMXt,t)  + Z*  for  0 <_  t <_  T, 

where 

t- 1 

zl  - l w(X„,u)  *(X.u), 
c u-D  u u 

z£  * ^ w(Xu,u)  «MXu,u), 

and 

\ - < - 0 • 

Then 

DT(i^,x,t)  - w(x,t)  pt(x)  E(s{Z"  + w(x,t)  (x,  t)  + Z^)  |xt»x)  . 

If  the  motion  is  Markov,  then  z£  is  independent  of  z”  when 
Xt  - x is  given.  If  b(z)  - 1 - exp(-z),  then  s(z)  • exp(-z). 
If  both  conditions  hole,  then 

Dx(ili,x,t)  - w(x,t)  P(\J/,x,t)  exp(-w(x,t)  \|>(x,t))  Q(i^,x,t)  , 
where 

P(^,x,t)  s pt(x)  E(a(z")  |xt-x) 

and 

Q(*,x,t)  = E(s(Z+)  !xt-x)  . 
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P(<Jj,x,t)  is  the  joint  probability  that  X^  - x and  that  the 
target  is  not  detected  by  any  of  the  searches  at  0,1,..., t-1; 
note  that  P(iJjrx(t)  does  not  depend  on  4>{y,u)  for  u t. 
Q(ii»,x,t)  is  the  conditional  probability  that  the  target  is 
not  detected  by  any  of  the  searches  at  t+l#...,T  given  that 
Xt«x;  note  that  Q(<j>,x,t)  does  not  depend  on  \j<(y,u)  for 
u £ t.  Given  y>,  and  Q(i|),x,t)  can  be  easily  computed 

recursively,  P(<|»,x,0)  is  a given  initial  distribution,  and 
P(i|i,xft+1)  can  be  obtained  from  P(ij;,x,t)  using  the  Markov 
transition  rule  and  ip(*,t).  Similarly,  Q(^,x,t)  2 1,  and 
Q(<|i,x, t-1)  can  be  obtained  from  Q(<j>,x,t}  using  the  Markov 
transition  rule  and  iji(*,t).  After  obtaining  P(\jj,x,t)  and 
Q ( <p, x , t) , it  is  a simple  matter  to  compute  DT(^,x,t)  and 
then  A(iJj)  . 

Algorithms  for  finding  the  optimal  effort  distribution 
typically  operate  by  generating  a sequence  » - - • 

that  approaches  The  method  of  computation  is  such  that 

can  be  computed  with  only  slightly  more  effort.  Consider 
the  discrete  case.  For  any  t,  the  probability  of  detection 
is 

(7)  P(i|d  - 1 - l P(ip,x,t)  exp(-w(x,t)  Hi(x,t))  Q (ij>,x,  t) 

x 

In  order  to  find  i|>*,  we  first  make  an  initial  guess  Q®(x,t) 
and  then  calculate  ’J>n  the  function  that  minimizes 
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for  n > 1, 


l ?(V,x,t)  exp(-w(x,t)  Y(x,t>)  Qn"1(x,t) 
x 

with  Qn(x,t)  • Q(iJjn,x,t)  for  n £ 1.  Each  of  the  min  imitation 
p rob  lama  la  relatively  simple,  and  it  can  be  shown  that  P(ijin) 
increases  with  n [1,2,3], 

For  each  of  the  minimization  problems,  there  must  exist 

a function  A (t)  such  that  D (x,  t)  ■ A (t)  when  ^n(x,t)  > Q 
n n n 

and  Dn(x,t)  <_  An(t)  whon  ifin(x,t)  ■ 0,  where 

Dn(x,t)  - w(x,t)  P(i])n,x,t)  exp(-w(x,t)  ipn(x,t))  Qn“1(x,t). 

These  are  simply  the  Kuhn-Tucker  conditions;  in  practice,  soma 

Bort  of  a search  is  made  until  A (t)  is  found  such  that 

n 

lx  <i> (x, t)  - m(t) . But 

!-  An<t)  Qn(x,  t)/Qn_1  (x,t)  when  i|>n(x,t)  > 0 

<Xn(t)  Qn(x,t)/Qn'1(x,t)  whan  *n(x,t)  -0 

so  computation  of  DT(<jjn,x,t)  is  a small  burden  given  that 
A (t>  , Qn(x,t),  and  Qn“^(x,t)  have  to  be  computed  in  any  case. 

In  the  continuous  case,  lx  is  replaced  by  / dx;  other- 
wise, the  development  remains  the  same. 
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4.  AN  EXAMPLE 


We  eet  t » 79,  bo  there  are  80  looks.  The  target  does 
a ranw.n  walk  over  the  cells  1,..#  67,  starting  at  call  34. 

At  each  opr ^rtunity , it  moves  left  with  probability  .3,  right 
with  probability  .3,  or  else  does  not  move.  The  boundary  is 
reflecting.  We  set  w(x,t)  ■ .001625  and  m(t)  « 100;  if  all 
100  units  of  search  effort  are  used  in  a single  cell,  the  prob- 
ability of  detection  would  be  1 - exp (.1625)  ■ .15  at  each 
of  the  80  opportunities.  We  also  set  Q°(x,t)  = 1. 

The  first  five  detection  probabilities  (and  values  for 
Mty))  are:  .7054  (.0393),  .7075  (.0246),  .7086  (.0120), 

.7090  (.0067),  and  .7092  (.0036).  The  amounts  of  CPU  time 
required  on  the  NPS  IBM  360/67  for  computation  of  each  of  these 
five  pairs  were  2.4,  2.8,  2.4,  2.0,  and  2.0  seconds,  respectively. 
The  second  pass  always  takes  a relatively  long  time  because 
Q1(x,t)  is  radically  different  from  Q°(x,t).  The  function 

5 

exp(-w(x,t)  (x, t) ) is  shown  to  three  decimal  places  in 
Figure  1,  with  ****  indicating  no  search.  Time  reads  down 
the  page  (there  are  80  rows) . Only  the  central  cells  are  shown) 
the  rest  are  not  searched. 

It  is  interesting  to  compare  these  results  with  those 
that  result  whan  all  effort  must  be  placed  in  a single  cell 
at  each  time.  The  bast  probability  of  detection  in  that  case 
is  apparently  . 64— sufficient  conditions  for  optimality  are 
not  known  in  that  case,  but  the  author  has  done  sufficient 
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experimentation  to  conjecture  that  .64  is  the  answer.  The 
increase  from  .64  to  .7092  can,  of  course,  be  attributed  to 
the  relaxation  of  a constraint. 
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FIGURE  1.  Survival  Probabilities  for  Near  Optimal  Search. 
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